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We study a modification of the Evoiutionary Minority Game (EMG) in which agents are piaced 
in the nodes of a regular or a random graph. A neighborhood for each agent can thus be defined 
and a modification of the usual relaxation dynamics can be made in which each agent updates 
her decision scheme depending upon the options made in her immediate neighborhood. We name 
this model the Local Evolutionary Minority Game (LEMG). We report numerical results for the 
topologies of a ring, a torus and a random graph changing the size of the neighborhood. We 
focus our discussion in a one dimensional system and perform a detailed comparison of the results 
obtained from the random relaxation dynamics of the LEMG and from a linear chain of interacting 
spin-like variables at a finite temperature. We provide a physical interpretation of the surprising 
result that in the LEMG a better coordination (a lower frustration) is achieved if agents base their 
actions on local information. We show how the LEMG can be regarded as a model that gradually 
interpolates between a fully ordered, antiferromagnetic system and a fully disordered system that 
can be assimilated to a spin glass. 



PACS numbers: 05.65.+b, 02.50.Le, 64.75.g, 87.23.Ge 

INTRODUCTION 

There are a great number of situations in which a many 
agent system self organizes by coordinating all the indi- 
vidual actions. A similar situation is found in many par- 
ticle, physical systems. The word "coordination" that is 
used in a social or economic context is replaced by "or- 
dering" in the study of condensed systems. Examples of 
self organization are for instance the growth of a crys- 
talline structure or a transition leading to some specific 
magnetic phase. 

Interesting situations arise in the case of systems in 
which the optimal configurations for different particles do 
collide with the each other. This is the case for instance 
in a spin glass in which many spins interact through a 
random interaction. In these cases the system is said to 
display some degree of frustration. A case of a multi- 
agent system displaying frustration that has been widely 
considered in the literature is the Minority Game (MG) 
0. In this model many players have to make a binary 
choice and the winning option is the one made by the mi- 
nority. Frustration may in general arise as a consequence 
of the particular nature of the interactions between the 
particles as in a spin glass, by the boundary conditions 
imposed by the geometry or the system, or the rules to 
win the game as in the case of the MG. The similari- 
ties between the MG and spin glass systems has been 
discussed in great detail by Ref. [2|. 

The macroscopic signature of frustration is that the 
many agent system can not accommodate into a single, 
optimal state in which the energy is a minimum but re- 
laxes instead to one of many, suboptimal configurations 
that correspond to local minima in the energy landscape. 



These configurations display what can be called quenched 
disorder i.e. fail to display an ordered pattern and the 
associated fluctuations do not disappear at zero temper- 
ature. In a spin glass the orientation of all the spins 
do not reach a unique ordering. In the usual relaxation 
dynamic that is used to model the MG, each player con- 
tinually modifies her choices and the final ordering of all 
the agents in terms of their respective choices is far from 
unique. 

The traditional MG ignores any possible spatial prox- 
imity among the players. In the present paper we place 
the agents in a lattice , thus associating a neighbor- 
hood to each player. We then let each player to make her 
decisions depending upon the options made by the play- 
ers of her neighborhood. We next consider a random re- 
laxation dynamics in which each player gradually adjusts 
her probability of choosing one given alternative of the 
binary choice. We call this model the Local Evolutionary 
Minority Game (LEMG). This framework is particularly 
suitable to study the interplay between frustration and 
size effects as well as the emergence of ordered patterns 
through the relaxation process. It also allows a direct 
comparison with a many spin system in which the size 
of the neighborhood is assimilated to the range of the 
spin-spin interaction. 

In this paper we present and discuss relevant results of 
numerical simulations of the LEMG played in one- and 
two-dimensional systems. We investigate the influence of 
the value of the size parameter - or what is the same, the 
range of the interaction - in the emergence of ordered, 
optimal configurations. We analyze the case of a one di- 
mensional system comparing the LEMG with a model 
inspired in an antiferromagnetic spin system at a finite 
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temperature. At the light of this comparison we show 
that the LEMG can be regarded as a model in which 
disorder is gradually introduced, the control parameter 
being the range of the interaction. A fully disordered 
system that corresponds to the well known EMG then 
appears to be a particular case in which the range of the 
interaction is the same as the size of the system. For any 
smaller value of the size parameter the system can be as- 
similated to an antiferromagnet. We use this to extend 
the model to include fluctuations like those produced by 
a finite temperature. This amounts to study the self or- 
ganization process implied in the LEMG including agents 
that change ltheir decision with a finite probability. The 
comparison has the by-product of providing a physical 
picture to understand why a finite range in the interac- 
tion among the agents has the effect of producing a better 
coordinated configuration with a lower frustration. 

THE RULES OF THE GAME 
The EMG 

We first consider the traditional EMG This in- 
volves N players that make one binary decision (0 or 1). 
Each player has a probability = 1, 2, • • • , N of choos- 
ing, say, 0. Each player receives one point if her decision 
places her in the minority and loses a point otherwise. 
We limit ourselves to consider the situation in which the 
amount of the loss is the same as the amount of the gain. 
The effect of relaxing this condition has been considered 
in 0. When her account of points falls below a given 
threshold, she changes pi — > p\ with p[ G [pi — Sp, pi + Sp] , 
at random, and Sp <C 1. Reflective boundary conditions 
are imposed at p t = 0, 1. All agents are assumed to up- 
date the corresponding pi 's synchronically. 

It is customary to display the self-organization of the 
system through the probability density function P{p) ob- 
tained in a statistical ensemble of systems that are al- 
lowed to relax to equilibrium. This function gives the 
fraction of the population having a probability between 
p and p + dp of choosing, say, 0. When the probabilis- 
tic relaxation is used, the asymptotic function P(p) is 
shaped as a U with two symmetric peaks at p ~ and 
p ~ 1 thus indicating that the N agents have segregated 
into two parties making opposite decisions. 

The relaxation process corresponds to the minimiza- 
tion of an "energy" function £ = a 2 /N \J\ where a is the 
standard deviation of the distribution of groups of agents 
defined by: 

a 2 = V(A)(A — N/2) 2 (1) 

A 

where V{A) is the probability distribution of groups of A 



agents that have chosen, say, 0. In |3 it is proven that: 
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£ =^ = N(<p>-l/2) 2 + (<p>-<p 2 >). (2) 

One can thus see that the value of a 2 depends upon the 
properties of the above mentioned P(p). At equilibrium 
a 2 is an extensive magnitude proportional to N. A min- 
imization of £ is equivalent to find a distribution P(p) 
with the smallest possible number of losers as follows 
from the fact that a 2 =< (A - N/2) 2 >=< (w - I) 2 > 
/4 =< (N — 2l) 2 > /4 where w (I) is the number of win- 
ners (losers). If one assumes naively P(p) = S(p —1/2) 
corresponding to a symmetric random walk (and also 
eliminating the term 0(N) in Eq.@ one gets £ = 1/4 
while P(p) = constant yields £ — 1/6. A better result is 
obtained with the usual random relaxation dynamics for 
the EMG yielding^ £ ~ 1/8. 

Energy and frustration remain linked to each other. 
For the EMG we can define frustration as T = l/N; 
which fulfills < J- < 1. This definition may also be 
used for any system involving a game with multiple play- 
ers. The value T — corresponds to a situation such 
as the "majority game" in which a player is a winner 
if her decision is the same as the majority. This leads 
to situations that can be assimilated to a ferromagnetic 
phase (all the players (spins) have chosen the same op- 
tion (orientation)). In the EMG there are less winners 
than losers, and therefore 1/2 < Temg < 1- The lowest 
possible frustration for the EMG is reached when the N 
(odd) agents are coordinated to produce the largest pos- 
sible minority, i.e. (N — l)/2. Thus the lowest possible 
frustration for a finite EMG is T* EMG = 1/2(1 + l/N). 

The LEMG 

Within the LEMG a set of neighborhoods {A/i} is con- 
structed, one for each player. All neighborhoods have 
the same (odd) number n of agents. We consider that 
the i — th agent belongs to A/i. We define a size param- 
eter by £ = n/N . We define the set of neighborhoods 
assuming two possible spatial orderings that correspond 
respectively to a one-dimensional chain (ID) or a square 
two-dimensional (2D) regular grid, both with periodic 
boundary conditions (i.e. corresponding respectively to 
a ring or a torus). When the agents are placed in a reg- 
ular lattice the set {A/i} can be generated as a sliding 
(linear or square) window of size n. 

The rules of the LEMG are the same as for the EMG 
except for the important difference that an agent wins or 
loses points depending whether she is, or she is not, in 
the minority of her own neighborhood. The i— th agent 
pays no attention whatsoever to the agents that do not 
belong to A/i . The LEMG contains the EMG as a partic- 
ular case. In fact the LEMG with ( = 1 (or n — N) is an 
A-fold replica of the usual EMG when A/i coincides with 
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the complete iV-agent system. In the regular orderings 
in which the neighborhoods are respectively a segment or 
a square with an odd number of agents, the only agent 
that updates her pi is located at the center of the square 
or segment. All agents are assumed to check their respec- 
tive neighborhoods and update the corresponding values 
synchronically. 

In spite of the fact that each player adjusts her decision 
according to her respective neighborhoods, we will be 
interested in computing the energy of the whole system, 
i.e. we want to check whether the choices made by each 
agent according to her respective neighborhoods lead the 
whole ensemble to a more efficient coordination scheme. 
Notice that in principle there are no reasons to assume 
any kind of correlation between local and global optima: 
an agent may be a winner in her neighborhood and a loser 
when the entire system is considered and vice versa. 



RELEVANT FEATURES OF THE LEMG 
The density distributions P(p) 

The density distribution functions P(p) that are ob- 
tained with the LEMG for ID systems are shown in Fig^ 
The results shown are an average over 200 samples, each 
one involving 5xl0 5 time steps. Results for 2D systems 
are completely similar. The main noticeable difference of 
these functions with those obtained without the neigh- 
borhood structure is that they drop essentially to zero in 
an interval that is symmetric around p = 1/2. 

As C grows, the shape of the corresponding Pq(p) 
changes. For £ ~ 1/2 the distribution has radically 
changed into the peculiar "two winged" shape || that 
can be seen in the figures, keeping unchanged the fact 
that P^(p ~ 1/2) = 0. This is associated to the rapid sta- 
bilization of a noticeable majority of one kind of agents 
in most neighborhoods. 

When this happens the agents are naturally induced 
to take repeatedly the same winning option and keep ac- 
cumulating points stopping the self- segregation process 
that is typical of the MG. The many agent system gets 
"frozen" (Ref. 0) in a configuration that is far from 
the "better" local optimum. A suboptimal configuration 
of this kind can be improved resorting to an annealing 
procedure (see Ref.[t|) that amounts to periodically re- 
move the points accumulated by all the players resetting 
their accounts to 0. In FigQ] the annealing procedure is 
applied every 500 time steps during the first 4xl0 5 up- 
datings. It can be seen that the annealing procedure is 
irrelevant for values of ( of the order of ~ and ~ 1. 
The distribution functions obtained after the application 
of such annealing procedure regain the well known U- 
shape that displays the self-segregation of the ensemble 
of agents into two subpopulations with pi ~ and pi ~ 1 
as a consequence of the relaxation dynamics. 
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FIG. 1: Density distribution function for a ID system with 
iV=121 agents, and C=0.091 (a), 0.587 (b) and 0.950 (c). 
Open circles correspond to ordinary relaxation, while full tri- 
angles correspond to an annealed relaxation. The full line in 
(c) corresponds to the EMG, and it is shown for comparison. 



The distributions obtained within the LEMG with or 
without annealing fail to reveal the neighborhood struc- 
ture of the LEMG. They are unrelated to the underlying 
neighborhood structure, do not signal the emergence of a 
long range order and therefore fail to provide any picture 
of the changes in the emergent ordering of the system as 
the size parameter changes. 
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FIG. 2: Results of the relaxation dynamics for a 2D system of 
961 agents located in a grid of 31x31 sites after 10 6 time steps. 
The values of the pi are shown in shades of gray. Left panel: 
neighbourhood of 3x3 sites. Rigth panel: neigbourhood of 
29x29 sites. Domains are clearly noticeable in the left panel, 
while on the rigth panel the whole system is in a single domain 



The emergence of a long range order 



Fig |21 we show some typical results for a ID system. In 
ID systems one can not find a domain structure in which 
portions of the chain in which one periodicity prevails are 
side by side with another portion in which the prevail- 
ing period is different. For larger values of £ strings of 
consecutive players with nearly opposite, extreme values 
of pi, all having lengths that are very close to a given 
length, alternate with each other randomly. In addition, 
this privileged length is close to n/3. 

It is interesting to note that the annealing procedure 
mentioned in the preceding section does not change in 
any way the long range ordering of the system. As can be 
seen in FigOan improvement of the optimum is achieved 
only by forcing the agents that already have pi > 1/2 or 
Pi < 1/2 to have pi's that are closer respectively either 
to 1 or to 0. As £ approaches 1 the long range ordering is 
seen to brake down: strings of consecutive players with 
opposite values of p change their lengths randomly. 



In Fig|2 we present the results obtained for the case 
in which the agents are placed in a two dimensional reg- 
ular lattice. We assume N — K 2 (K odd) and n = k 2 
(k odd). We show the values of the p^s at the end of 
the relaxation process by shades of gray. In all cases a 
pattern arises in which a long range order prevails that 
depends upon the type and the size of the neighborhood 
that has been chosen. If the neighborhood is assumed 
to contain only the four players that are N, S, E and W 
of the player updating her p i; a regular checkered pat- 
tern emerges that may also alternate with a pattern of 
"stairs" . If a complete neighborhood of eight neighbors 
is chosen the associated ordered pattern is one of vertical 
or horizontal stripes. For some values of k (k <C K) the 
stripes have indented edges. 

These regular patterns are in turn grouped into do- 
mains with rather sharp boundaries. These "disloca- 
tions" are a signature of conflicting boundary conditions 
(if K is odd the square with periodic boundary condi- 
tions can not accommodate an even number of stripes). 
Most of the agents that are "local losers" - and there- 
fore continue to update their pi 's - lie precisely on these 
borders giving therefore rise to a dynamics in which the 
domain borders slowly move. 

As the size parameter grows the whole grid becomes a 
single domain with wider stripes and the domain struc- 
ture naturally disappears. Beyond a critical value of £ 
the whole grid merges into a single domain. As £ be- 
comes even larger the edges of the stripes have noticeable 
indentations. Finally these dominate the whole picture 
and when £ ~ 1 all traces of a regular ordering completely 
disappear. 

Domains are a peculiar feature of 2D and higher di- 
mensional system. They do not appear in ID chains. In 



Energy minima 

We now consider the total energy £ = a 2 /N. In Fig0| 
we show results for £ as a function of £ obtained in sev- 
eral numerical experiments. The value for £ = 1, labeled 
£emg, is the one corresponding to the EMG. We show 
the results of the topologies of a ring and a random sys- 
tem. Data was obtained from 20 independent samples, 
each one of 5 x 10 5 time steps, by averaging over the 
last 2000 time steps of all the samples. The annealing 
procedure was applied as explained before. In a preced- 
ing paper we have pointed out the fact that the total 
energy and hence the degree of coordination of the N 
agents is always better for the LEMG than for the EMG 
provided that £ ~ 1 or £ ~ 0. In addition if the anneal- 
ing procedure is followed it turns out that £<; < £emg 
regardless the value of £. 

Quenched suboptimal configurations can be improved 
through annealing, making it possible to reach a"better" 
local configuration. The composition of the "good" lo- 
cal optima that are obtained in this way always yields 
values of £^ that are significantly lower that £emg- A 
typical value of £^ ~ 1/16 is obtained in this way that 
is half the value a 2 /N ~ 1/8 obtained for the stochastic 
relaxation dynamic. This remarkable results implies that 
when agents adjust their behavior taking into consider- 
ation only the agents of their immediate neighborhood 
(i.e. having a limited information about the system) they 
reach a better coordination than when each player con- 
siders the behavior of the total ensemble of players (i.e. 
has a better information about the system as a whole) . 
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FIG. 3: Results of the relaxation dynamics for a ID system 
of 501 agents, after 5x10 time steps. We plot the individual 
probabilities pi of the agents along the line (full squares). For 
clarity we show only a small, representative portion of the 
system. The doted lines are a guide to the eye. The full line 
is the result of rounding the value of Pi to zero or one. Panels 
(a) and (b) correspond to a neighborhood of 251 agents, while 
panel (c) corresponds to one of 501 agents, i.e. the EMG. 
Panel (b) is the annealed version of panel (a). Notice the 
periodicity displayed in (a) and (b), while the EMG result 
shows no long range order 
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FIG. 4: a 2 /N as a function of the size parameter £ for dif- 
ferent topologies of the system of N = 501 agents. Lines are 
drawn to guide the eye. Stars and squares correspond to ID 
and random graphs, respectively. Empty and filled symbols 
correspond to results obtained with and without annealing 
(see the text). 



THE ID CASE 

The salient features of the LEMG that we have re- 
ported in the preceding section can be summarized as 
follows. The stationary configuration that is reached at 
the end of the relaxation process, displays a long range 
order that is related to the size of the neighborhood n. A 
better understanding is desirable about that relationship 
as well as the collapse of the internal order as £ — > 1 . Fi- 
nally it is necessary to supplement the distribution func- 
tion P(p) with a more reliable indication of that internal 
order. The density function P(j>) clearly displays the 
self-segregation of the population but is not sensitive to 
the structure of neighborhoods. A similar statement can 
also be made about the energy £ introduced in Eq.Q. 
In spite of the fact that this function turns out to be sen- 
sitive to the neighborhood structure, £ is not an explicit 
function of it. In order to clarify these points we will focus 
our discussions on the ID case and we will explore many 
similarities between the LEMG and a system of interact- 
ing spins inspired in an antiferromagnetic Ising model. 
This can be tailored to be more sensitive to the struc- 
ture of neighborhoods and also allows a thermodynamic 
treatment through the introduction of a temperature and 
a free energy. 



The periodic patterns 



Let us consider an infinite linear chain of agents and 
a neighborhood with n = 3. Let Ri be the probability 
that the i-th agent belongs to the minority of Mi. We 
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can thus write, for % 



■ , oo: 



Ri = (1 -Pt-l)p»(l -Pi+l) -Pt)Pt+l ( 3 ) 

The probability that all agents are winners is 



(4) 



Obviously i? = 1 if and only if Ri = l,Vi . This is 
possible only in the case in which pi = 1 and Pi±i = 
(the opposite case in which pi = and = 1 is com- 
pletely equivalent). This situation corresponds to an or- 
dered pattern in which O's and the l's alternate with each 
other. This is a case in which the alternating strings are 
of unit length, that in turn corresponds to n/3. The case 
of an infinite linear chain is therefore not frustrated but 
any finite linear chain with periodic boundary conditions 
and with an odd number of agents is frustrated. 

It is possible to use Eq.® to construct a (discrete 
time) relaxation dynamics to adjust the Pi's. If we as- 
sume that Pi(t + 1) = pi(t) + Spi we can write 



ri /? 

Ri(t+1) ^R l + ^r -Spi 
OPi 



(5) 



we can therefore insure that Ri(t + 1) — Ri(t) > by 
choosing 



Spi = V 



dRj 
dpi 



r)(l - pi-x - pi+i) ; n > (6) 



A possible stationary solution (dpi = Vi) of Eq.JfJJ is 
Pi = 1/2 ;Vi. One can immediately recognize that this 
solution is unstable because any random, small pertur- 
bation of any pi leads to a dynamics in which Spi ^ 0; Vz. 
There are other stationary patterns such as the saw tooth 
profile that repeats the pattern pi = 1/2 — e, Pi+i = 0, 
Pi+2 = 1/2 + e, Pi+3 = 0, p i+i = 1/2 - e, etc. One 
can check that these solutions are also unstable. This 
dynamics stabilizes a pattern of O's and l's that alter- 
nate with each other. In fact if Pi+i and Pi-i are both 
greater (smaller) than 1/2, then Spi < 0(> 0) thus forcing 
Pi < l/2(> 1/2). In addition this relaxation dynamics 
leads to distributions P(p) that vanish at p — 1/2 as we 
have seen in the numerical experiments reported in the 
preceding section. 

Larger (odd) neighborhoods give rise to periodic pat- 
terns of alternating strings of O's and l's. It is simple 
to check by inspection that for a neighborhood of length 
n = 5 the length of the strings must be 2. However for 
n = 7, alternating strings of various lengths (1 ,2 and 3) 
are admissible. The coexistence of several periodic solu- 
tions for these rather small values of n is the responsible 
for the indented edges of the stripes that appear in 2D 



systems with a neighborhood with n = 49 (i.e. a square 
neighborhood of 7 sites in each direction). It is possi- 
ble to verify by direct inspection that a concatenation of 
strings of length n/3 tends to insure that players always 
belong to their local minorities. 

For large values of n, the relaxation dynamics leads 
to asymptotic stationary states in which shorter string 
lengths do not survive. One can understand this ef- 
fect on the grounds that a concatenation of short strings 
is highly unstable against fluctuations in their lengths. 
When longer strings are involved, a misadjustment by 
which there are neighboring strings with a length differ- 
ing in one unit, introduces few losers. A misadjustment 
of the same kind when short strings are involved causes 
a larger sequence of losers. 



A spin model for the LEMG 

The LEMG on a linear chain gives rise to a specific 
distribution of the lengths of strings of players that make 
similar decisions. This feature can fruitfully be stud- 
ied by mapping the LEMG into a spin model related to 
an Ising antiferromagnetic model. We consider a linear 
chain of spins Si, i = 1, 2, • • • , N with Si G { — 1, +1} and 
a system of neighborhoods of size n as considered above. 
In order to compare this model to the LEMG, each spin 
is assimilated to an agent and its twofold orientation is 
taken to correspond to the binary option for each agent. 

The Hamiltonian function that is a minimum when 
each agent belongs to the minority of her neighborhood 
is: 



H 



N 



n- 1 



E 



N 



£>Qi (7) 



The factor (n — l)^ 1 is introduced to have a unified 
scale of energies independent of the value of the size pa- 
rameter. The remaining factor 1/4 is instead introduced 
in order to render possible the correspondence of H with 
£ in the limit £ — ► 1. When n = TV, H can be written as: 



H = 



4(JV- 1) 



N N 

[(E^) 2 -E' 



(8) 



This expression can be cast into the form of Eq. by as- 
suming that N ^> 1 and that the discrete spin variables Si 
and the continuous probability variables pi can be asso- 
ciated with each other through |lfj Si — 2pi — 1 . Notice 
that the energy given by Eq.lJTJ) provides an extension 
of £ with an explicit dependence upon the neighborhood 
structure. This causes that a low value of H given by Eq. 
O , for some given value of n corresponds also to a low 
value of £ but the reciprocal is not true: one may find 
a low value of £ in which each player does not belong 
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to any local minority. This is because £ is associated 
with the balance within the whole ensemble of players 
between those that make one choice and those that make 
the opposite, while H refers instead to the interaction 
of each player with her neighborhood. The spin-spin in- 
teraction in Eq.Q is not that of a true antiferromagnet 
because becomes weaker with a larger n. This has been 
chosen in this way to resemble more closely the rules of 
the LEMG, in which each agent changes accordingly to 
the trend in her neighborhood, paying no attention to 
the actual number of agents in each side. 

A random relaxation dynamics that tends to minimize 
H consists in updating the spins of the system, randomly 
and asynchronously following the rule: 

Si(t) + 1) = -sign[Qi(t)] (9) 

This dynamics leads to asymptotic configurations that 
are the same as the ones obtained with the LEMG us- 
ing the random relaxation dynamics in both ID and 2D 
systems. In the 2D case it is obtained the same pat- 
tern of domains that accommodate horizontal and verti- 
cal stripes of widths that are determined by the size n of 
the neighborhood. 

The distribution of string lengths is displayed by the 
probability Pi of occurrence of a string of length £. In 
FigEl we compare the distribution Pi obtained for the 
LEMG minimizing H with the spin flipping dynamics of 
Eq.@, as the size of the neighborhood is changed. We 
show as an example the cases with N — 513 and n =67, 
507 and 513. For n = 67 very few string lengths survive 
and a fully ordered pattern emerges with strings of a 
length t ~ n/3 ~ 23. 

This noisy spectrum in Pi for n=507 is the signature of 
some degree of disorder of the system. This is, however, 
a quenched disorder because it appears in the absence of 
any fluctuation that can be attributed to a temperature. 
In fact as we will immediately see the relaxation dynam- 
ics of Eq. © can be considered to correspond to the limit 
T — > of a thermal relaxation dynamics. The disorder 
should therefore be attributed to the frustration imposed 
by the boundary conditions. In fact it becomes more im- 
portant when n/3 > AT/4, i.e. when the length of the 
system is no longer able to accommodate an even number 
of alternating strings with a length n/3. Such disorder 
dominates when n — 513 (i.e. £ = 1) which corresponds 
to the EMG; in this case Pi merges into a smooth expo- 
nential distribution. This agrees with the well known cor- 
respondence between the EMG with a disordered model 
of a spin glass. 

The results displayed above indicate that the LEMG 
and the spin model provide a similar physical insight. In 
both models, the size of the neighborhood is a control 
parameter that allows to gradually interpolate between 
a fully ordered antiferromagnetic system and a fully dis- 
ordered, spin glass like system. In the following section 



we study how the antiferromagnetic model allows a ther- 
modynamical approach that is difficult to envisage as an 
extension of the EMG. 

A THERMODYNAMIC TREATMENT 

The occurrence of a pattern of strings of 0's and l's is 
a signature of the LEMG that is reproduced within the 
antiferromagnetic model. The system gets ordered as a 
result of the minimization produced by the relaxation 
dynamics. In a general situation also random (thermal) 
fluctuations should be introduced in this process. These 
correspond to agents that have a finite probability of 
changing their decisions at any time. A low temperature 
can be associated to a very low probability of such change 
while the high temperature limit should be associated to 
agents that flip a coin to make up their minds. If ther- 
mal fluctuations are allowed, equilibrium corresponds to 
a minimum of a free energy and this in turn involves an 
energy minimization and an entropy maximization. In 
the present section we concentrate in this picture. We 
will restrict to consider a ID discrete spin system within 
the antiferromagnetic model. 

The string length distribution 

We now discuss how a long range ordering of the sys- 
tem emerges as a consequence of the minimization of a 
free energy. We focus the discussion of the present sec- 
tion on the case in which limjv^oo C — 0- The effects of a 
finite values of £ as N — ■> oo will be discussed in a forth- 
coming section within the framework of the spin model 
presented above. 

Let us assume a sequence of N 0's and l's randomly se- 
lected with equal probability. We therefore assume that 
Ni ~ A^o ^ N/2 up to terms 0(1/N). In what follows we 
shall assume that one kind of characters (say 0's) remains 
frozen and we will find the distribution of the lengths of 
strings of the other type (say l's). Due to the symmetric 
situation between the 0's and the l's, what we will con- 
clude for either one is also valid for the other. Let n m 
be the number of strings with m equal characters and 
let M be the total number of these sequences. Conse- 
quently the probability of occurrence of a sequence with 
m characters is P m — n m /M. In addition holds that 
^ m mn m = N/2. We can also define an average string 
length through £ = J2 m mP m . 

In order to construct a free energy we have two tasks, 
one is to define the entropy function and the other is 
to define the energy. The entropy of a configuration of 
strings can be calculated as the logarithm of the number 
of states in which M strings can be arranged preserving 
the fact that the n m strings of length m are indistinguish- 
able. Namely 
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FIG. 5: We show the probability distribution of the string length Pi, for a linear system of 513 agents, for three different 
neighborhoods. Full triangles correspond to the LEMG, while open circles are the results of the spin model. It can be seen that 
the n=507 case represents an intermediate situation between that of n=67 (fully ordered), and that of n=513 (fully disordered). 
Notice that the n=513 case is plotted in a semilog scale. 



S = log 



Ml 



-M^P m log(P m ) 



(10) 



We can now turn to find the distribution of the lengths 
of the strings. For this purpose we need only to evaluate 
the set {P m } that correspond to a minimum of the free 
energy per unit length 



The energy function £ for the same configuration of 
strings must depend upon the neighborhood structure 
and therefore must carry the information of the kind of 
local game that are playing the N agents of the system. 
If an energy function E m can be defined for a string of 
m equal characters, the energy of the ensemble of strings 
can naturally be defined as the weighted sum: 



e 



(ii) 



We have introduced £ in the denominator in order to work 
with energies per unit length. We stress the point that 
£ is an energy associated to an ensemble of strings and 
is connected to H as given in Eq. (J7J) only by the spin in- 
teraction that is used to calculate the energies E m . It is 
clarifying to consider the particular case of n — 3. In this 
case the energy E m can unambiguously be evaluated with 
a spin interaction as the one used in Eq. • Since the se- 
quence of m equal characters is flanked by one character 
of the other kind at both ends, E m can be calculated as 
in Eq.Q by sliding a window of width n = 3 along the 
sequence and counting the energy contributed by each 
position, namely: 



E n 



1 

-Y- 

4 ^ 



(12) 



An alternative possible calculation of E m is to use a sim- 
ilar sliding window and counting in each site if it corre- 
sponds to a local winner or loser. Notice that this proce- 
dure is exact only for n = 3. For a larger neighborhood 
additional hipoteses must be made concerning the envi- 
ronment in which the string is placed. We come back to 
this point later. 



F = £- 



TS 

N/2 



(13) 



In order to find a minimum of F, one still has to add 
a term with the Lagrange multiplier AQ3 m Pm — K) to 
impose the condition that J2 m ^ m = ^ =constant. We 
have introduced the thermodynamic temperature T that 
can be associated as usual to fluctuations in the arrange- 
ment of strings. We discuss in the next section the mi- 
croscopic influence of T in a spin model of the LEMG. 

In order to calculate the minimum of F we set: 



OF 



d£ 
dPi 



T 



1(1- 



• log P e )-£Y,P>r 



logP„ 



+ A = 



(14) 

This equation can be solved for A. In order to do so 
we first eliminate the explicit dependence on Pi by mul- 
tiplying by Pg and performing a summation over i. In 
this operation one can impose that ^2 Pg = K but, as 
expected, the normalization constant K remains unde- 
termined. Solving for A we obtain: 



X = -Z- (d£) 

i 



(15) 



with (d£) = J £2 m P m d£/dP m . Next A can be replaced in 
Eci. (|14|) to solve for log p. We finally obtain: 



— exp[-&S/^M] exp[-£A^/T] 
K 



(16) 



where Ai = d£ / dPg — (d£). Te normalization constant K 
is determined with the condition that Y]Pj = 1 because 
the PiS are probabilities of mutually excluding events. 
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The Eq. i|16|) provides the desired distribution of string 
lengths. It is interesting to consider the limits T — > oo 
and T — » 0. The high temperature limit yields a dis- 
tribution that dies exponentially with the length I of the 
strings as measured in units of the average length I. This 
is indeed the distribution found for the (random) distri- 
bution used as an initial state for the relaxation process 
used in the LEMG. As we shall see in the next subsec- 
tion, this is also found in the high temperature limit of a 
multi-spin model of the LEMG. 

An exponential tail in the distribution is the signa- 
ture of some kind of disorder. This can either be due 
to thermal fluctuations as in the present considerations 
or correspond to a quenched disorder of the system. The 
latter has been reported in the previous section as the re- 
sult of the relaxation process when the size of the neigh- 
borhood becomes equal to the size of the whole system. 
Such quenched disorder of the EMG also displays a dis- 
tribution that has an exponential distribution of string 
lengths. 

To investigate the limit of T — > we use Ea. l|TT|l and 
find that 

£Ag Ef. — £ sr-^ u (Et ~ E m ) 



This expression allows to find immediately the asymp- 
totic distribution of lengths in the limit T — > 0. Assume 
then that the set of the {E m } is ordered E mi < E m2 < 
■ ■ ■ < E„ lN . One can easily recognize that for T — > 0, 
and £ = tun the probability Pi — > because all expo- 
nents — (Ei — Ek)/T with k = nriN—i, m-N-2, ■ • ■ j m\ in 
the second exponential of Ea. (|16[) are negative causing 
Pi to approach exponentially for low T . A completely 
similar argument holds for £ = mjv-i,?n^-_2, • ■ ■ The 
only term that survives is t = mi the one corresponding 
to lowest energy E mi that, due to the normalization im- 
posed on the probabilities, must fulfill P mi — > 1. We 
thus see that in the low temperature limit the system 
gets organized by repeating only strings of a given length 
£ = mi that corresponds to minimum of E mi . This is 
what has been obtained both in the simulations reported 
and within the spin model. As we have seen before the 
length £ — 1 corresponds to n = 3. In general the sur- 
viving strings with a minimal E s are of a length that is 
close to one third the size of the neighborhood. 

Note that an energy E m can only be defined without 
ambiguity for the case of n = 3. This is so because the 
local energy of the first and last character of the sequence 
is completely defined. If the environment is larger, in 
order to calculate E m further considerations have to be 
made about the environment in which the sequence is 
placed. For larger neighborhoods the energy of longer 
strings can't be defined. In such a case an average over 
all possible environments could be made. However, such 
averaging procedure loses meaning as C approaches 1 and 
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FIG. 6: We show the probability distribution of the string 
length Pi, for a linear system of 513 agents, for n=33 and 
n=513 (EMG), and three different temperatures T = 1/(3. 

the considerations made for the low temperature limit are 
no longer applicable. 

The effects of a finite £ 
Thermal fluctuations in the antiferromagnetic model 

A microscopic interpretation of the temperature pa- 
rameter introduced in the preceding section is desirable. 
One possibility is to follow the line suggested in Ref.pJ. 
It has been shown there that the random relaxation used 
in the LEMG gives rise to fluctuations that can be as- 
similated to the introduction of a temperature parame- 
ter. The fact that the individual probabilities {pi} are 
updated by choosing the new value at random from an 
interval [p, — Sp, pi + Sp] with reflective boundary condi- 
tions at pi = 1 and pi — produces fluctuations in the 
energy function £ given in Eq.J2J). 

That way is however not acceptable. The introduc- 
tion of a finite temperature into the LEMG amounts to 
allow for "hesitating agents" that may change their cur- 
rent decision with a finite probability. The well known 
gradual updating rule of individual probabilities is un- 
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able to handle this situation. Within the antiferromag- 
netic model for the LEMG, such changes can easily be 
assimilated to a probabilistic flipping of spins in Eq.©. 
This temperature parameter is therefore different from 
the one introduced in because both are associated to 
a different kind of fluctuations. 

To deal with a finite temperature we proceed as usual, 
namely by assuming that a spin may flip with a proba- 
bility that depends upon [3 — 1/T through: 

Prob( Sl - -ai) = 1 + e 1 _ f}SiQi (18) 

that contains Eq.© in the limit of (3 — > oo (T — ► 0). 

The ordered pattern for the ID system in which few 
string lengths are strongly preferred only holds in the low 
temperature limit. The fluctuations introduced through 
the probabilistic flipping of Ea. (|18fl give rise to a ther- 
mal disorder that shows itself through the distribution 
function Pg. This competes with the quenched disorder 
produced for large values of the size parameter. As ex- 
pected, in the high temperature limit Pg ~ exp(— a£). 

In Fig|B^ we show how the ordered pattern of n = 33 
melts down as f3 — > while for n — 513 (FigHJ)) the 
exponential distribution does not change. The peak in P^ 
for n — 33 that represents an ordered pattern, gradually 
disappears, being replaced by an exponential for high 
T . The quenched disorder that appears for n = 513 is 
independent of T. 

The local energy function given in Eq.l|7)l is sensitive 
to the emergence of a local ordering. The relaxation in- 
dicated in Eq. I |18| l allows to perform a minimization of H 
while keeping control of the temperature. This allows to 
investigate the persistence of the local ordering and the 
competition between quenched and thermal disorder as 
the size of the neighborhood n approaches the size N of 
the whole system. 

In Fig0we show the result of the minimization process 
for two different values of £. As long as £ < 1 the local en- 
ergy is lowered as the relaxation proceeds, showing that 
a local ordering emerges. This reduction gradually be- 
comes less important as ( — » 1 and vanishes completely 
in that limit. This puts in evidence that when £ = 1 the 
relaxation process is unable to introduce any ordering 
into the system. 

The energy function given in Eq. J7J) is expected to show 
some degree of structure as the size of the neighborhood 
changes. This is due to the frustration caused by the 
competing boundary conditions that arise from the con- 
catenation of local minorities in neighborhoods that are 
comparable to the size of whole chain. Such structure 
can clearly be seen in the plot of H/N vs £ that is shown 
in FiglHl This pair of variables have been chosen because 
the corresponding curves turn out to be independent of 
N. The structure that is displayed must therefore be 
considered to be independent of the size of the system. 
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FIG. 7: Evolution of the local energy per site, from the mini- 
mization process on the spin model. The number of agents is 
./V=513; The values of n are show in the figure 

String lengths that are even fractions of N minimize 
the frustration because they better fulfill periodic bound- 
ary conditions of the whole system by accommodating an 
even number of strings of equal length along the chain. 
One therefore expect that the average string length must 
be related to N through £ = N/4, N/6, N/8 etc. On the 
other hand for an alternating pattern of +l's and -l's, 
the average string length must in turn related to the size 
of the neighborhood through £ — n/3, in order to achieve 
a minimal energy. An optimal ordering of the system is 
therefore possible for £ — 3/4, 3/6, 3/8, etc. These values 
are seen to correspond to minima of the curves in FiglHl 
The maxima in between correspond to a missmatch be- 
tween the value of the size of the neighborhood and the 
size of the whole system, causing that such optimization 
can not be achieved. This structure is seen not to survive 
to thermal fluctuations. 



CONCLUSIONS 

The MG has been greatly used as a working model for 
self-organization. Individual players, without any cen- 
tral coordination are nevertheless able to minimize a cost 
function that can be assimilated to an energy, by self- 
segregating into two different groups that make opposite 
elections. This features is neatly displayed by the density 
distribution of individual strategies that shapes as a U. 

If the rules of the game are extended by placing the 
agents into the nodes of a regular or a random graph 
several important changes occur. In the first place the 
density distribution of individual strategies turns out to 
be insensitive to the neighborhood structure of the new 
model. In the second place a long range spatial or- 
dering dominates the system. In the third place self- 
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FIG. 8: Energy per site as a function of C,for three differ- 
ent values of T = 1/(3. Empty (full) symbols correspond to 
iV=2001 (513) agents. 



organization is improved by producing lower value of the 
energy function. 

These features can fruitfully be studied in ID systems. 
We found that the distribution of strings of players that 
make similar options is a relevant parameter that pro- 
vides a signature of the type and kind of order that is in- 
duced in the system. This distribution changes between 
a delta-like function in which strings of a few lengths are 
allowed to survive to an exponential distribution of string 
lengths that is a signature of randomness. This transi- 
tion puts in evidence that the LEMG provides a gradual 
interpolation between an ordered system in the limit of 
small neighborhoods and a fully disordered system when 
the size of the neighborhoods approaches de size of the 
system. 

We have shown that the LEMG is equivalent to a spin 
system with an antiferromagnetic-like interaction that 
extends to a neighborhood whose size is taken as a con- 
trol parameter. This model displays the same pattern of 
local ordering and string length distribution and also dis- 
plays the same order-disorder transition when the range 
of the antiferromagnetic interaction approaches the size 
of the whole system. In addition an energy function can 
be introduced that can be considered as an extension of 
the LEMG in which the neighborhood structure is ex- 
plicitly accounted for. A minimum of such energy leads 
to a minimum of the energy function used for the LEMG 
but the converse is not true. 

The distribution of string lengths can also be studied 
in the thermodynamic limit of an infinite linear system 
of spins in a thermal bath. The temperature parameter 
that has to be introduced is absent in the LEMG and 
corresponds to hesitating agents that may change their 
decision with a finite probability at any time. Using this 
model we were able to find the high and low temperature 



limits of the probability distribution of string lengths as 
arising from a minimization of a free energy. The low 
temperature limit, merges for small neighborhoods into 
the one derived from the usual relaxation dynamics of the 
LEMG or the antiferromagnetic model yielding a delta- 
like distribution of lengths in which only very few priv- 
ileged lengths survive and a long range ordered pattern 
emerges. 

The high temperature limit can only be treated within 
the antiferromagnetic model. Within this framework an 
order-disorder transition can be predicted. Thermal ran- 
domness associated to the high temperature limit has 
the same exponential distribution of string lengths that 
is numerically obtained in the quenched disordered limit 
for zero temperature. We have also studied the effect of 
the interplay of the size of the system and the size of the 
neighborhood. We have shown that the energy of the 
spin system as a function of the size parameter can be 
cast into a form that is independent of the size of the 
system. This function that is highly structured puts in 
evidence the occurrence of "preferred" and "hampered" 
values of the size parameter that correspond to minima 
and maxima of the frustration introduced by conflicting 
boundary conditions. 

The ID system that we have considered in the present 
paper allows to get a detailed physical picture of the 
LEMG. It helps to understand how a structure of neigh- 
borhoods makes it possible a better ordering of the sys- 
tem that is in turn reflected as a minimum of the energy. 
Such ordered phase that is equivalent to an antiferro- 
magnetic ordering shows up as a better coordination of 
the decisions made by decentralized agents in a minority 
game. 
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